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I. REAL PARTY IN INTEREST 



The real party in interest for this appeal and the present application is Xerox 
Corporation, by way of an Assignment recorded in the U.S. Patent and Trademark Office at 
Reel 014676, Frame 0262. 
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II. RELATED APPEALS AND INTERFERENCES 

There are no prior or pending appeals, interferences or judicial proceedings, known to 

Appellants, Appellants' representative, or the Assignee, that may be related to, or that will 

directly affect or be directly affected by or have a bearing upon, the Board's decision in the 

pending appeal. 
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m. STATUS OF CLAIMS 



Claims 1-22 are on appeal. 
Claims 1-22 are pending. 
Claims 1-22 are rejected. 



3 



IV. STATUS OF A3VIENDMENTS 

No Amendment After Final Rejection has been filed. 
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V. SUMMARY OF CLAIMED SUBJECT MATTER 

The invention of independent claim 1 is directed to a pixel classification method 

([0001], [0013] and [0027], all citations reference the paragraphs and figures of the application 

as filed). The method includes detennining a background intensity level of an image ([0014], 

hnes 1-4; [0054], lines 8-10; [0055], lines 1-4; [0056], hnes 3-10; and [0058], lines 1 and 2; and 

in Fig. 9, 8910), the background intensity level being based on substantially all of the pixels of 

the image ([0014], lines 1-4; [0015], Unes 2-5; [0016], lines 2-4; [0056], lines 9-12; and [0058], 

lines 2-4; and Fig. 9, 8910), classifying a pixel of the image without adjusting an intensity of the 

pixel ([0015], Unes 5-7; [0016], hnes 4 and 5; [0027], Mnes 1-4; [0028], hnes 3 and 4; [0036], 

lines 3-5; [0040]; [0041]; [0042], lines 11-12; [0044], hnes 5-13; [0046], hnes 1-11; [0052], 

lines 1-3; and [0058], lines 4 and 5; and Fig. 9, 8920), confirrning the classification of the pixel 

based on the determined background intensity level of the image by comparing the intensity of 

the pixel with the determined background intensity level ([0014], lines 4-6; [0015], lines 5-8; 

[0016], lines 5 and 6; [0028], hnes 7-10; [0058], lines 5-7; [0062], lines 5-7; and [0063], lines 

1-3; and Fig. 9, 8930), determining if reclassification is required ([0054], hnes 8-11; [0058], 

lines 7-10; [0062], lines 5-7; and [0063], lines 1-3; and Fig. 9, 8940), and reclassifying the pixel 

when reclassification is required ([0016], line 7 and 8; [0027], hnes 12-14; [0054], lines 8-11; 

[0059], lines 1-7; [0060], lines 1-6; [0061], lines 1-4; and [0062], lines 10-12; and Fig. 9, 8940). 

The invention of independent claim 8 is directed to a pixel classification apparatus 

([0015], lines 1 and 2; [0027], lines 1-4; and [0042], lines 1-3). The apparatus includes a 

backgroxmd intensity level detennining module ([0015], lines 2-5 and [0027], lines 1-12; and 

Fig. 2, image processing unit 70 and computing unit 110, and Fig. 3) that detennines a 

background intensity level of an image based on substantially all of the pixels of the image 

([0014], hnes 1-4; [0015], lines 2-5; [0016], hnes 2-4; [0056], hnes 9-12; and [0058], hnes 2-4; 

and Fig. 9, 8910), and an image processing module ([0015], lines 5-8; [0027], hnes 1-12; 
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[0033]; and [0064], lines 1-7; and Fig. 2, image processing unit 70 and computing unit 1 10, and 
Fig. 3) that classifies a pixel of the image without adjusting an intensity of the pixel ([0015], 
lines 5-7; [0016], lines 4 and 5; [0027], lines 1-4; [0028], lines 3 and 4; [0036], lines 3-5; 
[0040]; [0041]; [0042], Unes 11-12; [0044], lines 5-13; [0046], lines 1-11; [0052], lines 1-3; and 
[0058], lines 4 and 5; and Fig. 9, S920), confirms the classification of the pixel based on the 
determined background intensity level of the image by comparing the intensity of the pixel with 
the determined background intensity ([0014], lines 4-6; [0015], lines 5-8; [0016], lines 5 and 6; 
[0028], lines 7-10; [0058], lines 5-7; [0062], lines 5-7; and [0063], lines 1-3; and Fig. 9, S930), 
determines if reclassification is required ([0054], lines 8-11; [0058], lines 7-10; [0062], lines 5- 
7; and [0063], lines 1-3; and Fig. 9, S940), and reclassifies the pixel when reclassification is 
required ([0016], hne 7 and 8; [0027], lines 12-14; [0054], lines 8-11; [0059], hnes 1-7; [0060], 
lines 1-6; [0061], lines 1-4; and [0062], lines 10-12; and Fig. 9, S940). 

The invention of independent claim 15 is directed to a image processing method 
([0001], [0013] and [0027]). The method comprises determining a background intensity level 
of an image ([0014], lines 1-4; [0054], lines 8-10; [0055], lines 1-4; [0056], Unes 3-10; and 
[0058], lines 1 and 2; and in Fig. 9, S910), the background level being based on substantially all 
of the pixels of the image ([0014], lines 1-4; [0015], lines 2-5; [0016], lines 2-4; [0056], Unes 9- 
12; and [0058], lines 2-4; and Fig. 9, S910), classifying a pixel of the image ([0015], lines 5-7; 
[0016], Unes 4 and 5; [0027], Unes 1-4; [0028], Unes 3 and 4; [0036], Unes 3-5; [0040]; [0041]; 
[0042], Unes 11-12; [0044], Unes 5-13; [0046], Unes 1-11; [0052], Unes 1-3; and [0058], Unes 4 
and 5; and Fig. 9, S920), checking the classification of at least a portion of the pixels of tite 
image based on the determined background intensity level of the image ([0014], lines 4-6; 
[0015], Unes 5-8; [0016], Unes 5 and 6; [0028], Unes 7-10; [0058], Unes 5-7; [0062], lines 5-7; 
and [0063], lines 1-3; and Fig. 9, S930), reclassifying pixels based on the results of the checking 
step ([0016], Une 7 and 8; [0027], Unes 12-14; [0054], lines 8-11; [0059], Unes 1-7; [0060], 
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lines 1-6; [0061], lines 1-4; and [0062], lines 10-12; and Fig. 9, S940), and processing the image 
data of the pixels of the image based on the classification of the pixels ([0016], lines 3-7; 
[0040], Unes 7-9; [0053], lines 1-4; [0064], lines 1-7). 
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VI. GROUNDS OF REJECTION TO BE REVIEWED ON APPEAL 
The following grounds of rejection are presented for review: 

1) Claims 1 and 8 are rejected under 35 U.S.C. §102(b) over Fan et al. (U.S. Patent 
AppUcation Publication No. 2003/0072487 Al) (hereinafter "Fani"); 

2) Claims 15, 16 and 22 are rejected under 35 U.S.C. §102(b) over Fan et al. (U.S. 
Patent No. 5,850,474) (hereinafter "Fan2"); 

3) Claims 2-7, 9-14 are rejected under 35 U.S.C. §103(a) over Fani in view of Li et al. 
(U.S. Patent No. 6,360,009) (hereinafter "Li"); and 

4) Clams 17-21 are rejected under 35 U.S.C. §103(a) over Fan2 in view of Li. 
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VII. ARGUMENT 

The cuirent claims on appeal are directed to method and an apparatus for classifying 

pixels and a method of processing an image. In particular, the claims recite method and 

apparatus that classify pixels of an image, and subsequently check the classification of the 

pixels based on the backgroxmd intensity of the image, and reclassify the pixels when the 

check indicates that a reclassification is necessary. The claims on appeal involve determining 

the background intensity of the image based on substantially all of the pixels in the image . As 

will be discussed below, with regard to the independent claims, the applied references fail to 

disclose or render obvious any such technique or apparatus. 

Arguments presented below have been previously submitted to the Examiner both in 

formal responses to Office Actions and in the personal interview conducted on November 6, 

2007. 

Appellants submit that independent claims 1 and 8 and their dependent claims stand 

or fall together, and that independent claim 1 5 and its dependent claims stand or fall together, 

but separate from claims 1 and 8. 

A. Claims 1-14 Are Not Anticipated or Rendered Obvious by 
Fani (U.S. Patent Application Publication No. 2003/0072487 
Al) or Fani in view of Li (U.S. Patent No. 6360,009) 

1. Independent Claims 1 and 8 

Fani is directed to a method for segmenting an image using a backgroxmd-based 

segmentation process. Fani discloses a method that requires the image under process to be 
processed at two different resolutions (low and original resolution). The process originates 
with segmenting the image and passing the image through a low pass filter. The image is 
decimated and processed at low resolution by a segmentation stage. The segmented results 
identify a main background portion of the image and other objects of the image. Thus, the 
main backgronnd is a segment of the image. Further, the process determines local 
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backgrounds and other objects for areas that are unable to be classified as text or pictures. 

This is repeated through an iterative process until all objects are classified as text or picture 

classes. This segmented low pass result is overlaid with the original resolution image. See 

paragraphs [0013] and [0014] of Fani. 

Fani goes on to disclose that that the image is segmented into a main background, 
local backgrounds, picture objects and text objects. See paragraph [0015] of Fani. Thus, 
even Fani's main background is segmented, and therefore, it is not based on substantially all 
of the pixels of the image, Fani also discloses that the border of the main backgroimd and 
other adjacent backgroxmds and objects is refined. Fani discloses that the main background is 
determined by identifying NxN uniform blocks and growing the uniform blocks by assessing 
the color difference of adjacent pixels. The plurality of the NxN blocks are grown, and the 
block with the largest bounding area is identified as the main background. See paragraph 
[0021] of Fani. Thus, Fani discloses that the main background or any determined 
backgroimd of the Fani method is not based on substantially all of the pixels. Furthermore, 
Fani bases background detection on color differences , and not intensity . The Final Rejection 
asserts that the "main background" 304 of Fig. 3 of Fani corresponds to an intensity level. 
However, the Final Rejection fails to provide a technical or even brief or suggestive 
explanation of how the element 304 corresponds to an intensity level. Appellants submit that, 
despite the allegations of the Final Rejection, Fani discloses that background determinations 
are based on color, not intensity levels. 

Independent claims 1 and 8 recite a method and apparatus that determine a 
backgroimd intensity level of an image based on substantially all of the pixels of the image . 
As described above, Fani fails to disclose, render obvious or even address intensity levels, 
and therefore fails to determine a backgroimd intensity level. Furthermore, Fani fails to base 
any determination, let alone a background intensity level determination, on substantially all of 
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the pixels of the image. Conversely, Fani repeatedly describes segmenting the image and then 
determining color differences to assign properties. Thus, Fani fails to disclose or render 
obvious a method or apparatus that determines a background intensity level of an image, the 
background intensity level being based on substantiallv all of the pixels of the image. 

Furthermore, because Fani fails to determine a background intensity level of an 
image, Fani fails to disclose or render obvious the method or module that confirms the 
classification of a pixel based on the determined backgroimd intensity level of the image by 
comparing the intensity level of the pixel with the determined backgxound intensity leveL 
deterniining if reclassification is required, and reclassifying the pixel when the reclassification 
is required, as recited by independent claims 1 and 8. Fam fails to disclose determining 
intensity levels, and therefore cannot confirm a classification as recited by Appellants* claims. 
Accordingly, Fani also is unable to compare a pixel intensity level with a backgroimd 
intensity level. 

Fani discloses a reclassification; however, the reclassification of Fani is based on the 
size of the object being reclassified. See Fani, paragraph [0027]. Additionally, Fani 
discloses reassessing backgrounds to determine if the backgrounds are sweeps in step 412 of 
Fig. 10. The reassessment is based on breaking up the backgroimd area into multiple (16) sub 
regions and determining the maximum color difference between the regions. If the difference 
is larger than a predetermined threshold, the background is reclassified as a picture object. 
See Fani, Fig. 10 and paragraphs [0034] and [0035]. This is not confirming the classification 
of the pixel based on the determined background intensity level of the image by comparing 
the intensity of the pixel with the determined background intensity level, determining if 
reclassification is required, and reclassifying the pixel when reclassification is required, as 
recited by independent claims 1 and 8. 
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2, Dependent Claims 2-7 and 9-14 
Li fails to cure the deficiencies of Fani described above with respect to claim 1 and 8 

from which claims 2-7 and 9-14 depend. Accordingly, claims 2-7 and 9-14 are patentable 

over Fani and Li, for at least the same reasons that claims 1 and 8 are patentable. Appellants 

request reversal of all rejections of claims 1-14. 

B. Claims 15-22 Are Not Anticipated or Rendered Obvious by Fanz (U.S. 
Patent No. 5.850.474) or Fan^ in view of Li (U.S. Patent No. 6.360.009) 

1. Examiners Acknowledge the Impropriety of the Fani Rejections 
At the personal interview of November 6, 2007 between the Appellants' 

representatives and Examiner Woldemariam and his supervisor Examiner Ahmed, the 

Examiners openly acknowledged that the reference Fan2 fails to anticipate the current 

application's claims. The interview summary states "The examiner agreed to withdraw the 

rejections based on U.S. Patent Nimiber 5,850,974 [sic] to Fan et al." Although the summary 

states Patent No. 5,850,974, it is clear that this was a typographical error and the citation in 

the interview summary was meant to be, 5,850,474. 5,850,974 is to Kettl et al. and addresses 

fluid jets, and therefore is clearly not the patent intended to be cited m the interview 

summary. Thus, even the Examiner and his supervisor previously agreed that Fan2 fails to 

disclose or render obvious the claim features of independent claim 15 and its dependent 

claims. 

2. Independent Claim 15 

Fan2 discloses a method and apparatus for segmenting a page of image data into 

windows, and classifying the data within each window as a particular type of image data. 
Fan2 discloses a process in which each pixel is examined and classified (Fig. 1, SlOl). The 
pixels are then broken into runs, and the runs are classified based on the pixel classification 
(Fig. 1, SI 03). Fan2 discloses combining the runs to create windows (Fig. 1, SI 05) and 
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statistics on the windows are generated (Fig. 1, SI 07). Subsequently, Fan2 classifies the 

windows based on the statistics (Fig. 1, SI 09). Fan2 repeats the pixel examination (Fig.l, 

Sill), run determination (Fig. 1, SI 13) and window formation (Fig.l, SI 15), and labels all 

pixels with the classification of image type as was determined for the window Avithin which 

the pixels reside (Fig. 1, S117). Fana is silent with respect to backgrounds. Fan2 fails to 

make any determinations regarding backgrounds, including determining a background 

intensity level of an image . Further, Fana bases determinations on individual pixels, runs, and 

window statistics, and therefore Fan2 fails to disclose or render obvious basing anythmg on 

substantially all the pixels of the images. Thus, Fan2 fails to disclose or render obvious 

determining a background intensity level of an image, the backgroxmd level being based on 

substantially all of the pixels of the image, as recited by independent claim 15. 

Moreover, Fan2 fails to disclose or render obvious checking the classification of at 

least a portion of the pixels of the image based on the determined background intensity level 

of the image and reclassifying pixels based on results of the checking step, as recited by 

independent claim 15. Fan2 discloses a macro-detection step followed by a micro-detection 

step. Fan2 fails to disclose or suggest checking classifications of pixels based on the 

background intensity level of the image. Fan2 discloses a confidence factor that is associated 

with image runs. The confidence factor is based on the uniformity of intensities of only 

pixels within the run. See col. 6, lines 14-26. The confidence factor is used to indicate a 

probability that an image type classification is correct. Reclassifications may occur if the 

confidence factor is low. The reclassification is based on the context of surroimding image 

runs and/or the context of the previous scan line. See col. 6, lines 57-59. Thus, Fan2 fails to 

disclose or render obvious checking classifications of pixels based on the background 

intensity level of the image, as recited by independent claim 15. 
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3. 



Dependent Claims 16-22 



Claims 16 and 22 depend firom claim 15, and thus are patentable over Fana for at least 

the same reasons as claim 15. Li fails to cure the deficiencies of Fan2 and therefore 

dependent claims 17-21, which depend from claim 15, also are patentable. Appellants 

respectfully request the Board to reverse all rejections of claims 15-22. 

Vin, CONCLUSION 

For all of the reasons discussed above, it is respectfully submitted that the rejections 

are in en'or and that claims 1-22 are in condition for allowance. For all of the above reasons. 

Appellants respectfully request this Honorable Board to reverse the rejections of claims 1-22. 



JAO:MAC/mem 

Oliff & Berridge, PLC 
P.O. Box 320850 
Alexandria, Virginia 22320-4850 
Telephone: (703) 836-6400 

Filed: July 8, 2008 




James A. Oliff 



Registration No. 27,075 



Mario A. Costantino 
Registration No. 33,565 



14 



Xerox Docket No. D/A3648 
Application No. 10/709,833 

m 

APPENDIX A - CLAIMS APPENDIX 
CLAIMS INVOLVED IN THE APPEAL: 

1 . A pixel classification method, comprising: 

detemiining a background intensity level of an image, the background intensity level 
being based on substantially all of the pixels of the image; 

classifying a pixel of the image without adjusting an intensity of the pixel; 

confirming the classification of the pixel based on the deterroined backgroimd 
intensity level of the image by comparing the intensity of the pixel with the determined 
backgroimd intensity level; 

determining if reclassification is required; and 

reclassifying the pixel when reclassification is required. 

2. The pixel classification method of claim 1, wherein the determining step 
comprises determining a white point of the image based on at least one characteristic of 
substantially all of the pixels of the image. 

3. The pixel classification method of claim 2, wherein the confirming step 
comprises comparing the intensity of the pixel with an intensity of the white point of the 
image. 

4. The pixel classification method of claim 3, wherein the reclassifying step 
includes reclassifying the pixel as background when the pixel is classified as a class eligible 
to be reclassified and the intensity of the pixel is not less than the intensity of the white point 
of the image. 

5. The pixel classification method of claim 3, wherein the reclassifying step 
includes reclassifying the pixel as one of smooth contone and an equivalent class when the 
pixel is classified as background and the intensity of the pixel is less than the intensity of the 
white point of the image. 
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6. The pixel classification method of claim 1, wherein the determining step 
comprises identifying a spread of intensity levels of substantially all the pixels of the image 
and determiiiing an intensity level of a majority of the pixels. 

7. The pixel classification method of claim 4, wherein the pixel is classified as 
smooth contone. 

8. A pixel classification apparatus, comprising: 

a background intensity level determining module that determines a background 
intensity level of an image based on substantially all of the pixels of the image; and 

an image processing module that classifies a pixel of the image without adjustmg an 
intensity of the pixel, confirms the classification of the pixel based on the detemiined 
background intensity level of the image by comparing the intensity of the pixel with the 
determined background intensity level, determines if reclassification is required, and 
reclassifies the pixel when reclassification is required. 

9. The pixel classification apparatus of claim 8, wherein the background intensity 
level determining module determines a white point of the image based on a characteristic of 
substantially all of the pixels of the image. 

10. The pixel classification apparatus of claim 9, whereia the image processing 
module confirms the classification of the pixel by comparing the intensity of the pixel with 
the intensity of the white point of the image. 

1 1 . The pixel classification apparatus of claim 1 0, wherein when a pixel is 
classified as a class eligible to be reclassified and the intensity of the pixel is not less than the 
intensity of the white point of the image, the pixel is reclassified as background. 

12. The pixel classification apparatus of claim 10, wherein when a pixel is 
classified as background and the intensity of the pixel is less than the intensity of the white 
point of the image, the pixel is reclassified as smooth contone. 
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13. The pixel classification apparatus of claim 8, wherein the image processing 
module identifies a spread of intensity levels of substaatially all the pixels of the image and 
determines an intensity level of a majority of the pixels. 

14. The pixel classification apparatus of claim 1 1, wherein the pixel is classified 
as one of smooth contone and an equivalent class. 

15. An image processing method, comprising: 

determining a background intensity level of an image, the background level being 
based on substantially all of the pixels of the image; 
classifying a pixel of the image; 

checking the classification of at least a portion of the pixels of the image based on the 
determined background intensity level of the image; 

reclassifying pixels based on results of the checking step; and 

processing image data of the pixels of the image based on the classification of the 

pixels. 

16. The image processing method of claim 15, fixrther comprising storing a label 
associated with each of substantially all of the pixels, wherein the label of each of 
substantially all of the pixels is based on results of the classification step and the checking 
step for the pixel. 

17. The image processing method of claim 15, wherein classifying a pixel of the 
image comprises classifying the pixel as one of smooth contone, rough contone, text, 
background, graphics and halftone. 

1 8. The image processing method of claim 15, wherein the determining step 
comprises determining a white point of the image based on a characteristic of substantially all 
of the pixels of the image. 



A-3 



Xerox Docket No. D/A3648 
AppUcationNo. 10/709,833 

1 9. The image processing method of claim 1 8, wherein the checking step 
comprises comparing an intensity of the pixel with an intensity of the white point of the 
image. 

20. The image processing method of claim 19, wherein when the pixel is classified 
as smooth contone and the intensity of the pixel is not less than the intensity of the white 
point of the image, the pixel is reclassified as background. 

21 . The image processing method of claim 19, wherein when the pixel is classified 
as background and the intensity of the pixel is less than the intensity of the white point of the 
image, the pixel is reclassified as smooth contone. 

22. The image processing method of claim 15, wherein the portion of the pixels 
comprises substantially all of the pixels of the image. 
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